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Abstract. The paper addresses a new class of combinatorial problems 
which consist in restructuring of solutions (as structures) in combina- 
torial optimization. Two main features of the restructuring process are 
examined: (i) a cost of the restructuring, (ii) a closeness to a goal solu- 
tion. This problem corresponds to redesign (improvement, upgrade) of 
modular systems or solutions. The restructuring approach is described 
and illustrated for the following combinatorial optimization problems: 
knapsack problem, multiple choice problem, assignment problem, span- 
ning tree problems. Examples illustrate the restructuring processes. 
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1 Introduction 

The paper addresses a new class of combinatorial problems which are targeted 
to restructuring of solutions (e.g., a set of elements, a structure) in combinatorial 
optimization. Two main features of the restructuring process are examined: (i) 
a cost of the initial problem solution restructuring, (ii) a closeness the obtained 
restructured solution to a goal solution. Fig. 1 depicts the restructuring process. 
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Fig. 1. Illustration for restructuring process 



This kind of problems corresponds to redesign/reconfiguration (improvement, 
upgrade) of modular systems and the situations can be faced in complex software, 
algorithm systems, communication networks, computer networks, information 



systems, manufacturing systems, constructions, etc. ([T], [2], [3], [5], [B], [7], [TU]). 
Here an optimization problem is solved for two time moments: ti and T2 to 
obtain corresponding solutions and S*^. The examined restructuring problem 
consists in a "cheap" transformation (change) of solution to a solution S** 
that is very close to . This restructuring approach is described and illustrated 
for the following combinatorial optimization problems (e.g., [3], [B]): knapsack 
problem, multiple choice problem, assignment problem, spanning tree problems. 
Numerical examples illustrate the restructuring processes. 



2 General Restructuring Problems 



The restructuring problem may be used for many combinatorial optimization 
problems as changing a solution (e.g., subset, structure), for example: (i) rank- 
ing (sorting) problem, (ii) knapsack problem, (iii) multiple choice problem, (iv) 
clustering problem, (v) assignment/allocation problems, (vi) bin-packing prob- 
lem, (vii) graph coloring problem, (viii) vertex covering problems, (ix) clique 
problem, (x) spanning tree problem, and (xi) Steiner problem. Here it is neces- 
sary to take into account a cost of solution changes (e.g., removal of a Steiner 
node). Fig. 2 illustrates the restructuring problem. 



Obtained 
solution S 




Solution 
change cost 
H{S^ -> S 



Goal, 
solution 
{t = t2): 



Initial PiS*,S^) 
\ solution 



Ti . Neighborhoods 
Froximity ^2 



Fig. 2. Illustration for restructuring problem 



Let P be a combinatorial optimization problem with a solution as structure S 
(i.e., subset, graph), H be initial data (elements, element parameters, etc.), f{P) 
be objective function(s). Thus S{f2) be a solution for initial data ^2, f{S{^2)) be 
the corresponding objective function. Let f2^ be initial data at an initial stage, 
f{S{^2^)) be the corresponding objective function. be initial data at next 
stage, f{S{fl'^)) be the corresponding objective function. 

As a result, the following solutions can be considered: (a) = S{fl^) with 
f{S{^2^)) and (b) 5^ = 5(12^) with f{S{f2'^)). In addition it is reasonable 
to examine a cost of changing a solution into another one: H{S°' S^). Let 
p{S°',S^) be a proximity between solutions and , for example, p{S°' , S^) = 
1/(5'") — f{S^)\. Note function f{S) is often a vector function. Finally, the 
restructuring problem can be examine as follows (a basic version): 



Find a solution S* while taking into account the following: 
(i) H{S'^ S*) min, (ii) p{S*,S'^) min (or constraint). 



Thus the basic optimization model can be examined as the following: 

min p{S*,S^) s.t. H{S^ ^ S*) <h, 

where /i is a constraint for cost of the solution change. Fig. 3 illustrates re- 
structuring of a multicriteria problem. Note proximity function p(S*,S'^) (or 
p(5*^ , {521, 5^2, can be considered as a vector function as well (analog- 

ically for the solution change cost). This situation will lead to a multicriteria 
restructuring problem. 
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Fig. 3. Restructuring of multicriteria problem 



3 Restructuring in Some Combinatorial Problems 

Let A = (1, ...,n} be an initial set of elements. Knapsack problem is con- 
sidered for two time moments n and T2 (for T2 parameters {cf }, (af }, and b'^ 
are used) (Fig. 4): 
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Fig. 4. Restructuring in knapsack problem 



max^c^Xj s.t. ^a^Xj < b^, Xi G {0,1}. 

i=l i=l 

The corresponding solutions are: C A {t = Ti) and S"^ C A {t = T2) {S^ ^ S^). 
Illustrative numerical example: A = {1,2,3, 4, 5, 6, 7}, 5^ = {1, 3, 4, 5}, 

52 = {2, 3, 5, 7}, S* = {2, 3, 4, 6}. The change (rcstnictnring) process (i.e., S'^ ^ 
S*) is based on the following (Fig. 5): (a) deleted elements: S^*~ — S^\S* = 
{1,5}, (b) added elements: S^*+ = S*\S^ = {2,6}. 
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Fig. 5. Example for restructuring 



Note the following exists at the start stage of the solving process: S^* = 
and S^*^ = A\S^. The restructuring problem can be considered as the following: 

minp{S*,S') s.t. H{S'^S*) = { E V+ E ) <h, Y.a^<b^ 

where ft is a constraint for the change cost, h~ (i) is a cost of deletion of element 
i £ A, and h'^{i) is a cost of addition of element i G A. On the other hand, an 
equivalent problem can be examined: 

max E ^'^i ^(^' ^S*) = {J2 V + E )<h, E ^ 

because max^^^^. ccjcf < max^.^^s a;jC? while taking into account con- 
straint: X^igg. a| < The obtained problem is a modified knapsack-like prob- 
lem as well. At the same time, it is possible to use a simplified solving scheme (by 
analysis of change elements for addition/deletion): (a) generation of candidate 
elements for deletion (i.e., selection of from S^), (b) generation of candidate 
elements for addition (i.e., selection of 5^+ from Ay^*^). The selection processes 
may be based on multicritcria ranking. As a result, a problem with sufficiently 
decreased dimension will be obtained. 

Basic multiple choice problem is for t = ti (for t = T2 parameters {cfj}, 
{a^j}, and 6^ are used): 

m qi m qi qi 

maxEE'^^7^'-'' EE'^^J^'-J' - E^*-? - ''" = 1>"^> Xij € {0,1}. 



Here initial element set A is divided into m subsets (without intersection): A = 
iXLiAi, where Ai = {1, ...,qi} {i = l,m). Thus each element is denoted 
by An equivalent problem is: 

max ^ clj s.t. ^ a]j<b\ \S^SzAi\ < l^i = i;m. 

For t ~ T2 the problem is the same. 

Illustrative numerical example: A = {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}, 
Ai = {1,3,5,12}, A2 = {2,7,9}, ^3 = {4,8,13}, A4 = {6,10,11}, = 
{1, 7, 8, 11}, 5*2 = {3, 7, 8, 10}, S* = {1, 2, 8, 6}. The change (restructuring) pro- 
cess (i.e., S*) is based on the following (Fig. 6): (a) deleted elements: 
51*- = S\S* = {7,11}, (b) added elements: S^*+ = S*\S^ = {2,6}. 

Thus the restructuring problem can be considered as the following: 

min p{S*,S^) 
(i.jOesi— (i,j)esi'-+ (i,j)es* 

< 1 yi = i;m. 

where his a constraint for the change cost, h~ (ij) is a cost of deletion of element 
e A, and h'^{ij) is a cost of addition of element e A. An equivalent 
problem is: 

max 4- 

s.t. His'^s*) = { ^^0+ ^3)^^^ E 4<^'' 

(i,j)esi— (i,j)esi*+ (i,j)es* 

< 1 Vi = I^. 

The simplest version of algebraic assignment problem is: 

m n m n 

™^^EE4i^i.i s-^-E^^'J = 1'"-; E^*'-?' < 1)« = Xjj e {0,1}. 

1=1 j=l i=l j=l 

This problem is polynomially solvable. Let us consider n = m. Thus a solu- 
tion can be examined as a permutation of elements A = {1, ..,n}: S =< 
s[l], ...,s[i], ..,s[n\ >, where s[i] defines the position of element i in the resultant 
permutation 5. Let c{i,s[i]) > {i = l,n) be a "profit" of assignment of 
element i into position s[i] (i.e., ||c(i, s[i]) || is a "profit" matrix). 
The combinatorial formulation of assignment problem is: 

Find permutation S such that c(i, s[i]) — > max. 

Now let us consider three solutions (permutations): 



(a) =< si[l], s^[i], .., si[n] > fov t = n, 

(b) =< .s^[l],...,s^[i],...s^[n]> for t = T2, and 

(c) S* =< s*[l],...,s*[i],..,s*[n] > (the restructured solution). 
Illustrative numerical example: A = {1, 2, 3, 4, 5, 6, 7}, 

5'! = {2,4,5,1,3,7,6}, = {4, 1, 3, 7, 5, 2, 6}, 5* = {2, 4, 3, 1, 5, 7, 6}. 

Here the following changes are made in S*^: 5 ^ 3, 3 ^ 5. Clearly, the 
changes can be based on typical exchange operations: 2-exchange, 3-exchange, 
etc. 

Further, let us consider a vector of structural difference (by components) for 
two permutations and S^: {s"[i] — s^[i],i ^ l,n} and a change cost matrix 
||(i(i,j)|| {i = l,n, i = l,n). Here d{i,i) = \/i — l,ri. Evidently, the cost for 
restructuring solution into solution S* is: H{S^ S*) = h{s^[i\,s*[i\). 
Proximity (by "profit" ) for two permutations S" and may be considered as 
follows: p{S°',S^) = IEr=ic"(«,s"W) -Er=ic''(«'«''H)l- Finally, the restruc- 
turing of assignment is (a simple version): 

n 

mmp{S*,S^) s.t. ^^(^i ^S**) =^/i(si[i],s*[i]) </i. 

i=l 

Restructuring problems for minimal spanning tree problem and for Steiner 
tree problem are described as follows (Fig. 6, Fig. 7). The following numerical 
examples are presented: 

I. Initial graph (Fig. 6): G = ( A, £;) , where A = {1, 2, 3, 4, 5, 6, 7}, 
E^{{1, 2), (1, 4), (1, 5), (1, 6), (2, 3), (2, 6), (3, 6), (4, 5), (4, 6), (5, 6), (5, 7), 
(6,7)}. 

II. Spanning trees (Fig. 6): 

(i) Ti = {A. £1), where = {(1. 2), (1. 4), (1. 6), (3. 5), (5. 6), (6. 7)}, 

(ii) r2 = (A, £;2), where E"^ = {(1, 2), (2, 3), (2, 6). (4, 6), (5, 6), (6, 7)}, 

(iii) T* = (A, E*), where E* = {(1, 2), (1, 4), (2, 3), (2, 6), (3, 5), (6, 7)}. 
Here the edge changes are (T^ -^T* a.s E^ E*): 

E^*- = {(1, 6), (5, 6)} and E^*+ = {(2, 3), (2, 6)}. 
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Fig. 6. Restructuring of spanning tree 



III. Steiner trees (Fig. 7, set of possible Steiner vertices is Z = {a, b, c, d}): 
{i) = {A\E^), where A^=A\JZ\ = {a,b}, 



= {(1, 2), (1, a), (a, 4), (a, 6), (3, 5), (&, 5), (&, 6), (&, 7)}, 

(ii) = where A2 = ^UZ2, ^ {a,b,d}, 

- {(3, 4), (1, d), (3, d), (a, d), (o, 4), (a, 6), (6, 6), (6, 5)), (6, 7)}, 

(iii) S* = {A\E*), where where A* = A[jZ*, Z* = {a,c}, 
E* = {{l,2),{l,a), {a, 4), (a, 6), (c, 3), (c, 5), (c, 6), (6, 7)}. 
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Fig. 7. Restructuring of Steiner tree 
Thus the restructuring problem for spanning tree is (Fig. 6, a simple version): 
min p(T*,T2) s.t. H{S^ ^ 5*) = ( ^ h' + ^ h+ ) <h, 

where ft is a constraint for the change cost, h~{i) is a cost of deletion of element 
(i.e., edge) i £ E^, and h'^{i) is a cost of addition of element (i.e., edge) i e E\E^. 
The restructuring problem for Steiner tree is (Fig. 7, a simple version): 

min p{S*,S^) 

s.t. H{s'^s*) = { J2 K+ E ht) + { E E ^t)<h, 

ieE^*- ie_Ei'+ iezi*- i£Z^'-+ 

where /i is a constraint for the change cost, h~{i) is a cost of deletion of element 
(i.e., edge) i £ E^, h'^{i) is a cost of addition of element (i.e., edge) i & E* C 
E\E^, w~{j) is a cost of deletion of Steiner vertex j € Z^, w~^{j) is a cost of 
addition of Steiner vertex j € Z* C Z\Z^. 

In the main, the suggested restructuring problems are NP-hard and enumer- 
ative algorithms or heuristics can be used. The design/selection of heuristics 
may be based on some typical situations. First, the restructuring problems of- 
ten are based on two selection subproblems: (a) deletion of elements and (b) 
addition of elements. This leads to possible usage of greedy-like algorithms. If 
the restructuring problem is based on exchange of elements (e.g., restructuring 
in assignment/allocation problem) local heuristics as k-exchange techniques can 
be used (e.g., 2-OPT, 3-OPT for travelling salesman problems). Further, meth- 
ods of constraint programming can be widely used. Evidently, many well-known 
meta-heuristic methods can be used as well. In addition, heuristic can be based 
on reducing of the basic restructuring problem, for example: (a) by problem 
type, (b) by problem dimension (e.g, selection of the most prospective change 
operations), etc. 



4 Illustrative Application Examples 



Example 1. Reconfiguration of "microelectronic components part" in wireless 
sensor (multiple choice problem) M — R-kPirD-kQ [8/. 

1. Radio R: 10 mw 916 MHz Radio i?i(3), 1 mw 916 MHz Radio i?2(2), 
10 mw 600 MHz Radio i?3(2), 1 mw 600 MHz Radio Ri{l). 

2. Microprocessor P: MAXQ 2000 Pi(l), AVR with embedded DAC/ 
ADC Pa (2), MSP Pz{?,). 

3. DAC/ADC D: Motorola 131(2), AVR embedded DAC/ADC £"2(1), 
Analog Devices 1407 1)3(2). 

.j. Memory Q: 512 byte RAM gi(3), 512 byte EEPROM g2(3), 8 KByte 
Flash g3(2), 1 MByte Flash Q4(l)- 



Table 1. Estimates of DAs 
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Here it is assumed that solutions are based on multiple choice problem (in 
[8] the solving process was based on morphological clique problem while taking 
into account compatibility of selected DAs). Thus two solutions M-^ (for t = ti, 
Fig. 8) and AP (for t = T2, Fig. 9) are examined (in [S] the solutions correspond 
to trajectory design: stage 1 and stage 3). Table 1 contains estimates of DAs 
(expert judgment). Estimates of cost (Table 1) and priorities (Fig. 8, Fig. 9, in 
parentheses) correspond to examples in [8] . Here Cij = 4 — pij . Two possible 
change operations can be considered {M^ ^ M* , M* is close to Af^ ): 

(a) i?4 — i?2, h~ — 2, h'^ = 1 (corresponding Boolean variable Xa 6 {0, 1}), 

(b) Q4 -> Qi, ~ 1, /i^ ~ 1 (corresponding Boolean variable Xb G {0, 1}). 
As a result, the following simplified knapsack problem can be used: 

max ( (c2(i?2) - c^iRi)) Xa + {c\Qi) - c\Qi)) Xb ) 
s.t. H{M* ^ M^) = { h-{R4:^R2) + h+{Ri^R2))xa+ 



{h-{Q4. Qi) + h+{Qi Qi) ) Xb<h. 

Finally, the restructuring solutions are: (i) h = 2: M*^ = i?4*P2 ^£'2 

{ii)h^3: A/*^ = i?2*^2*£)2*Q4, {m)h = 5: Af*^ = = i?2*-P2*£'2*(9i- 
Evidently, real restructuring problems can be more complicated. 

Example 2. Reassignment of users to access points ([7], [S])- Here the initial 
multicriteria assignment problem involves 21 users and 6 access points. Tables 
2, 4 contain some parameters for users (A) (coordinates {xi,yi,Zi), required 
frequency spectrum fj, required level of reliability Vj, etc.) and some param- 
eters for 6 access points {B = {j} = {1,2,3,4,5,6}) (coordinates {xj,yj,Zj), 
frequency spectrum /j, number of connections nj, level of reliability rj) ([7], 
[S]). A simplified version of assignment problem from [7] is considered. Two re- 
gions are examined: an initial region and an additional region (Fig. 10). In [7] 
the problem was solved for two cases: (i) separated assignment S*^ (Fig. 10), 
(ii) joint assignment (Fig. 11). The restructured problem is considered as 
a modification (change) of into 5**. To reduce the problem it is reasonable 
the select a subset of users (a "change zone" near borders between regions): 
A — {i} — {3,5,8,12,13,14,17,19,21}. Thus, it is necessary to assign each 
element of A into an access point of B. 

Table 3. Users-access points 



Table 2. Access points 
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The considered simplified restructuring problem is based on set of change 
operations: (1) user 3, change of connection: 1 — > 4 (Boolean variable xi), 
(2) user 13, change of connection: 3—7-6 (Boolean variable X2), (3) user 21, 
change of connection: 5 — 2 (Boolean variable X3). Table 3 contains estimates 
of change costs (expert judgment) and "integrated profits" of correspondence 
between users and access points from ([7], [9]). The problem is: 



s.t. ( (/ig^i -I- h+) xi 



max ( C3,4 xi + ci3,6 X2 + 021,2 X3 ) 

iK3,3 + f^lSfi) 2^2 + (^2"l,51 + ^21,2) X3) <h. 



The reassignment S* is depicted in Fig. 12 (i.e., xi = 0,xi — 1,X3 — 1, h — 5). 
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Fig. 11. Joint assignment S"^ 




Fig. 12. Joint assignment S* 



5 Conclusion 



In the paper a restructuring approach in combinatorial optimization is suggested. 
The restructuring problem is formulated as a combinatorial optimization prob- 
lem with one objective function. Multicriteria problem statement is briefly de- 
scribed as well. The restructuring approach is applied for several combinatorial 
optimization problems (knapsack problem, multiple choice problem, assignment 
problem, minimum spanning tree, Steiner tree problem). Some application do- 
mains are pointed out (e.g., sensors, communication networks). The suggested 
restructuring approach is the first step in this research field. Clearly, it is reason- 
able to consider other types of system reconfiguration problems. In the future 
it may be prospective to consider the following research directions: 1. applica- 
tion of the suggested restructuring approach to other combinatorial optimization 
problems (e.g., covering, graph coloring); 2. examination of multicriteria restruc- 
turing models; 3. examination of restructuring problems with changes of basic 
element sets (i.e., ^ J^); 4- study and usage of various types of proximity be- 
tween obtained solution(s) and goal solution(s) (i.e., p{S* , S'^)); 5. examination 
of the restructuring problems under uncertainty (e.g., stochastic models, fuzzy 
sets based models); 6. reformulation of restructuring problem(s) as satisfiability 
model(s); 7. usage of various AI techniques in solving procedures; and 8. appli- 
cation of the suggested restructuring approaches in engineering/ CS education. 
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